Image file processing apparatus which generates an image file to include stereo image data, collateral data related to the stereo image data, information of a date and time at which the collateral data is updated, and information of a date and time at which the image file is generated or updated, and corresponding image file processing method

ABSTRACT

In generating stereo image data based on a plurality of monocular images of the same subject with a predetermined parallax, a metadata generating section generates collateral data, related to stereo image data, and an image file generating section generates information related to a date and time at which collateral data was generated or updated. Stereo image data and collateral data are synthesized into an image file. Information, related to a date and time at which collateral data was generated or updated, and information, related to a date and time at which the image file is generated or updated, are further added for conversion to a predetermined file format to generate the image file. Using information related to such date and time makes it possible to appropriately process, edit and reproduce a subsequent stereo image even when the stereo image is processed and edited with non-3D-compliant equipment or software.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation application of PCT/JP2005/007866filed on Apr. 26, 2005 and claims the benefit of Japanese ApplicationsNo. 2004-130127 filed in Japan on Apr. 26, 2004, No. 2004-130128 filedin Japan on Apr. 26, 2004, the entire contents of each of which areincorporated herein by their reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing apparatus, an imageprocessing and editing apparatus, an image reproducing apparatus, animage processing method, an image processing and editing method andimage file reproducing method suitable for capturing and editing and thelike of a stereo image.

2. Description of the Related Art

A wide variety of systems for shooting and recording an image,containing stereo information, and reproducing the image for observationhave heretofore been proposed. Among these, a so-called two-eye-typestereo system, which is arranged to record two images with a parallax,corresponding to visual points of left and right eyes, and providesthese two images to the left and right eyes, individually, has thesimplest structure capable of producing a profound effect in spite oflow cost and has been used from old times up to the present date.

With the two-eye-type stereo system, even though a so-calledpersonal-use-type device has the restrictions of only one person beingable to observe the image at one time, a system employing a stereo pairimages is the most fundamental and classic method and has been stillwidely used today as a system enabling the observation of a clear stereoimage at an extremely low cost.

An example of a stereo image pickup apparatus employing a stereo adapteris disclosed in Japanese Unexamined Patent Application Publication No.2002-218506 (hereinafter referred to as Patent Document 1). PatentDocument 1 discloses technology wherein a system controller includes astereo adapter detector section for detecting the loading or unloadingof a stereo adapter, an automatic exposure (AE) control section foranalyzing a subject image signal, related to a measured light area, forcalculation of measured light information needed for exposure control,and a measured light area setting section for setting theabove-described measured light area and having a function of settingmeasured light areas different from each other in accordance with anormal shooting mode and a stereo shooting mode for thereby enabling thesetting of measured light areas optimum for the normal shooting mode andthe stereo shooting mode.

In such a way, the two-eye-type stereo system adopts a method ofdisplaying the same subject on one image frame at left and right areasthereof in the form of two images (hereinafter referred to as monocularimages) misaligned from each other in accordance with a parallax. Thatis, with the two-eye-type stereo system, with a view to obtaining astereoscopic feeling from the one image frame (hereinafter also referredto as an integrated image) with the monocular images placed on the leftand right areas of the image frame, the monocular images placed in theintegrated image on the left and right areas thereof are observed withthe right eye or the left eye, individually. Fusing the two imagesobserved with the left and right eyes into one image enables an image tobe recognized with a stereoscopic feeling. The image (hereinafterreferred to as a fused image) appearing on recognition causesperspective to occur in various parts depending on the amount ofmisalignment in various parts of the left and right monocular images.

And now, image data, dealt by an electronic camera, includes a dataformat under the Exif standard that has become widely used. The Exifstandard adheres to a file (JPEG file) format under the JPEG standard.That is, image data is treated as image data under the JPEG standard andthe JPEG files each have a header portion Exif data (metadata). Metadataof the Exif standard is described in the TIFF format and includesinformation such as a shooting date and time and thumbnails and thelike.

Information, related to a stereo image, can be described using suchmetadata. For instance, in practice, the left and right monocular imagesresulting from the shooting with the use of the stereo adapter encounteran eclipse occurring on a boundary area or deviation occurring in afocused position. With a view to correcting such an eclipse andpositional deviation or the like, predetermined portions of the left andright areas are subjected to trimming to form set areas (hereinafterreferred to as image frames) for effective monocular images. Since theareas of the image frames have much effect on a depth feeling of thestereo image, a need arises for the image frames to be appropriately setwhen processing and editing the stereo image. Describing information orthe like, related to the trimming, with metadata allows the image framesto be appropriately set, making it possible to provide the fused imagewith an appropriate depth feeling.

And now, it is conceived that processing and editing software can beused to process and edit the stereo image. In such a case, it is notalways true that the processing and editing is performed usingprocessing and editing software (herein after referred to as3D-compliant software) compliant with stereo images, and it is alsoconceived that the processing and editing may be executed usingprocessing and editing software (hereinafter referred to asnon-3D-compliant software) noncompliant with stereo images.

Commonly used processing and editing software is compliant with the Exifstandard. Therefore, even when processing and editing the stereo imagewith non-3D-compliant software, image data can be processed withoutcausing damage to a metadata area. However, it is difficult to edit themetadata area related to the stereo image using non-3D-compliantsoftware.

SUMMARY OF THE INVENTION

The present invention provides an image processing apparatus includesstereo image data generating means for generating stereo image data onthe basis of a plurality of monocular images on the same photogenicsubject obtained with a predetermined parallax, collateral datagenerating means for generating collateral data related to the stereoimage data, collateral data date and time information generating meansfor generating information related to a date and time when thecollateral data was generated or updated, and image file generatingmeans for generating an image file upon synthesizing stereo image data,generated by the stereo image data generating means, and collateraldata, generated by the collateral data generating means, and convertingto a predetermined file format, data obtained by further adding to thesynthesized data, information, related to a date and time when thecollateral data generated by the collateral data date and timeinformation generating means is generated or updated, and informationrelated to a date and time when the image file is generated or updated.

An image processing and editing apparatus according to another aspect ofthe present invention includes image processing and editing means forperforming image processing and editing on the basis of stereo imagedata in an image file generated by converting to a predetermined fileformat, data obtained by synthesizing stereo image data, generated onthe basis of a plurality of monocular images on the same photogenicsubject obtained with a predetermined parallax, and collateral data,related to the stereo image data, and further adding information,related to a date and time at which the collateral data was generated orupdated, and information related to a date and time at which the imagefile is generated or updated, collateral data updating means forupdating the collateral data, before the image processing and editing isconducted, on the basis of a content of the image processing andediting, collateral data updating date and time information generatingmeans for generating information related to a date and time at which thecollateral data is updated, and image file generating means forgenerating an image file upon synthesizing stereo image data imageprocessed and edited by the image processing and editing means, andcollateral data, updated by the collateral data updating means, andconverting the image file to a predetermined file format upon furtheradding information related to a date and time, at which the collateraldata, generated by the collateral data date and time informationupdating means, is updated, and information related to a date and timeat which the image file is generated or updated.

An image file reproducing apparatus according to a further aspect of thepresent invention includes reproducing means for reproducing an imagefile generated by converting to a predetermined file format, dataobtained by synthesizing stereo image data, generated on the basis of aplurality of monocular images on the same photogenic subject obtainedwith a predetermined parallax, and collateral data, related to thestereo image data, and further adding information, related to a date andtime at which the collateral data was generated or updated, andinformation related to a date and time at which the image file isgenerated or updated, judging means for judging a coincidence betweeninformation, related to a date and time at which the collateral data,reproduced by the reproducing means, is generated or updated, andinformation related to a date and time at which the image file isgenerated or updated, and controlling means for inhibiting continuedreproduction operation of the reproducing means in the presence ofjudgment made by the judging means of an inconsistency.

An image processing apparatus according to a still further aspect of thepresent invention includes stereo image data generating means forgenerating stereo image data on the basis of a plurality of monocularimages on the same photogenic subject obtained with a predeterminedparallax, collateral data generating means for generating collateraldata related to the stereo image data, stereo image size informationgenerating means for generating information related to an image size ofthe stereo image data, and image file generating means for generating animage file in conversion to a predetermined file format uponsynthesizing stereo image data, generated by the stereo image datagenerating means, and collateral data, generated by the collateral datagenerating means, and further adding information, related to the imagesize generated by the stereo image size information generating means, tothe collateral data at inner and outer areas thereof.

An image processing and editing apparatus according to yet anotheraspect of the present invention includes image processing and editingmeans for image processing and editing on the basis of stereo image datacontained in an image file generated by converting to a predeterminedfile format, data obtained by synthesizing stereo image data generatedon the basis of a plurality of monocular images on the same photogenicsubject obtained with a predetermined parallax, and collateral data,related to the stereo image data, and further adding information,related to the image size of the stereo image data, to the collateraldata at inner and outer areas thereof, collateral data updating meansfor updating the collateral data, prior to the data being subjected tothe image processing and editing, on the basis of an image processingand editing content, stereo image size information updating means forupdating information related to individual image sizes for the imageprocessing and editing content for information, related to an image sizeof the stereo image data prior to the data being subjected to the imageprocessing and editing, which is added to the collateral data at innerand outer areas thereof, individually, and image file generating meansfor generating an image file in conversion to a predetermined fileformat upon synthesizing stereo image data image processed and edited bythe image processing and editing means, and collateral data, updated bythe collateral data updating means, and adding data, related to imagedata updated by the stereo image size information updating means, to thecollateral data at inner and outer areas thereof.

An image file reproducing apparatus according to a yet still furtheraspect of the present invention includes reproducing means forreproducing an image file generated by converting to a predeterminedfile format, data obtained by synthesizing stereo image data, on thebasis of a plurality of monocular images on the same photogenic subjectobtained with a predetermined parallax, and collateral data, related tothe stereo image data, and further adding information, related to theimage size of the stereo image data, to the collateral data at inner andouter areas thereof, individually, judging means for judging acoincidence between information, related to an image size contained inthe inside of the collateral data, reproduced by the reproducing means,and information related to an image size contained in the outside of thecollateral data, and controlling means for inhibiting continuedreproduction operation of the reproducing means in the presence ofjudgment made by the judging means of an inconsistency.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing an electronic camera incorporating animage processing apparatus of a first embodiment according to thepresent invention.

FIG. 2 is a block diagram showing a specific structure of an image filegenerating section 50 c in FIG. 1.

FIG. 3 is an illustrative view showing an example of an image filegenerated by the image file generating section 50 c.

FIG. 4 is a flow chart showing an operational flow of the image filegenerating section 50 c.

FIG. 5 is a block diagram showing an image processing and editingapparatus of a second embodiment according to the present invention.

FIG. 6 is a flow chart showing a processing flow for generating an imagefile.

FIG. 7 is a block diagram showing an image file reproducing apparatus ofa third embodiment according to the present invention.

FIG. 8 is a flow chart showing a processing flow of an image file.

FIG. 9 is a block diagram showing an electronic camera incorporating animage processing apparatus of a fourth embodiment according to thepresent invention.

FIG. 10 is a block diagram showing a specific structure of an image filegenerating section 50 c shown in FIG. 9.

FIG. 11 is an illustrative view showing an example of an image filegenerated by the image file generating section 50 c.

FIG. 12 is a flow chart showing an operational flow of the image filegenerating section 50 c.

FIG. 13 is a block diagram showing an image processing and editingapparatus of a fifth embodiment according to the present invention.

FIG. 14 is a flow chart showing a processing flow for generating animage file.

FIG. 15 is a block diagram showing an image file reproducing apparatusof a sixth embodiment according to the present invention.

FIG. 16 is a flow chart showing a processing flow of an image file.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereunder, an embodiment of the present invention is described in detailwith reference to the accompanying drawings. FIG. 1 is a block diagramshowing an electronic camera incorporating an image processing apparatusof a first embodiment according to the present invention. The presentembodiment represents a case applied to an image file recordingapparatus.

First Embodiment

In FIG. 1, an electronic camera comprises a camera body 1, a lens unit 5having a lens barrel, and a stereo adapter 10 for shooting a stereoimage. In the electronic camera, the stereo adapter 10 of a mirror typeis detachably mounted on the lens unit 5. The stereo adapter 10 takesthe form of a structure that includes mirrors 11, 12, placed inpositions spaced from each other by a distance corresponding toparallax, and mirrors 13, 14 for guiding light beams, reflected from themirrors 11, 12, to the camera.

The light beams, passing through the mirrors 11, 13 and the mirrors 12,14 disposed inside the stereo adapter 10, pass through a shooting lensgroup 21 in the lens unit 5 to an exposure control mechanism 22 and thenare guided to a half mirror 31 mounted inside the camera body 1.

The lens unit 5 comprises the shooting lens group 21, the exposurecontrol mechanism 22, a lens drive mechanism 23, a lens driver 24 and anexposure control driver 25.

The shooting lens group 21 plays the role of a main image pickup opticalsystem, which is capable of picking up an image (as a monocular pickedup image) with normal monovision in a state in which no stereo adapter10 is mounted, and is driven with the lens drive mechanism 23 to adjustthe focusing or zooming. The lens driver 24 controls the lens drivemechanism 23. The exposure control mechanism 22 is configured to controla lens diaphragm of the shooting lens group 21 and a shutter apparatus(not shown). The exposure control driver 25 controls the exposurecontrol mechanism 22.

The light beams, guided to the camera body 1 from the lens unit 5, passthrough the half mirror 31 and are then guided through a low pass andinfrared cut filter system 32 to a CCD color image pickup element 34 forimage formation. The CCD driver 35 controllably drives the CCD colorimage pickup element 34 for conversion of an optical image of thephotogenic subject into an electric signal. Note that, for the CCD colorimage pickup element 34, use is made of, for instance, an image pickupelement of a vertical type overflow drain structure of an interline typeand progressive (sequential) scan type.

The light beam incident on the left vision mirror 11 of the stereoadapter 10 is focused on a region L of an imaging area (not shown) ofthe CCD color image pickup element 34 via the mirror 13 and the shootinglens group 21. Likewise, the light beam incident on the right visionmirror is focused on a region R of another imaging area (not shown) ofthe CCD color image pickup element 34 via the mirror 14 and the shootinglens group 21.

The CCD color image pickup element 34 executes photoelectric conversionto generate signals that are delivered through a preprocessing circuit36, including an A/D converter, etc., to a digital processing circuit 39for executing color signal generation processing, matrix conversionprocessing and other related various digital processing. The digitalprocessing circuit 39 executes the processing of digitized image signalsthereby generating color image data.

An LCD display section 40 is connected to the digital processing circuit39 to which a memory card 42, such as a CF (Compact Flash Memory Card),smart media or the like, is also connected via a card interface (IF) 41.The LCD display section 40 provides a display on the basis of colorimage data, and the memory card 42 stores color image data.

In addition, the memory card 42 can be connected to an external personalcomputer 60. The image, recorded on the memory card 42, can be displayedon and subjected to image processing in the personal computer 60.Further, the image, recorded on the memory card 42, can also be printedout using a printer (not shown).

Since the half mirror 31 is structured to partially reflect light beamsof an incident subject image, reflected light beams are guided to an AFsensor module 45. The AF sensor module 45 detects focuses according tothe incident light beams incoming through the shooting lens group 21.The AF sensor module 45 comprises a pupil division separator lens 46 andan AF sensor 47 composed of a line sensor.

A system controller 50, composed of a CPU, etc., performs integratedcontrol on various parts inside the camera body 1 and the lens unit 5.The lens driver 24, the exposure control driver 25, the CCD driver 35,the preprocessing circuit 36, the digital processing circuit 39 and theAF sensor module 45 are connected to the system controller 50 to whichan operation switch section 52, an operation display section 53, anon-volatile memory (EEPROM) 51 and a stereo changeover switch (SW) 54are also connected.

The operation switch section 52 comprises a variety of switches such asa release switch, a shooting mode setter, etc. The operation displaysection 53 plays the role as a display unit for displaying anoperational status of the camera, a mode status, etc.

The EEPROM 51 plays the role as a memory to store various presetinformation or the like. The stereo changeover switch 54 acts as achangeover switch for shifting modes when the stereo adapter 10 isconnected to the lens unit 5. In addition, while the shooting mode isherein described as being shifted upon operating the stereo changeoverswitch 54, the present invention is not limited to such operation. Forinstance, the stereo adapter 10 may have a detecting function toautomatically perform changing of the shooting mode.

The system controller 50 allows the exposure control mechanism 22 andthe CCD driver 35 to controllably drive the CCD color image pickupelement 34 for reading out an exposure (in stored electric charge) andthe related signals. With the system controller 50, outputs of the CCD34 are supplied through the preprocessing circuit 36 to the digitalprocessing circuit 39 with which various signals are processed andresulting signals are recorded on the memory card 42 via the cardinterface 41.

A stroboscopic lamp 57 generates a flashlight and is controlled by thesystem controller 50 via the exposure control driver 25 incorporated inthe lens unit 5.

The system controller 50 further includes an exposure control section 50d and a measured light area setting section 50 e. The exposure controlsection 50 d analyzes the subject image signals related to a measuredlight area and calculates exposure information demanded for exposurecontrol. Moreover, the measured light area setting section 50 e sets ameasured area for the exposure control section 50 d.

With the present embodiment, the system controller 50 further includes ametadata generating section 50 a, a stereo image generating section 50 band an image file generating section 50 c.

The metadata generating section 50 a, acting as collateral datagenerating means, generates a variety of collateral data (hereinafterreferred to as metadata), related to a picked up image, for delivery tothe image file generating section 50 c. For instance, with informationof a shooting date and time and a picked up image belonging to a stereoimage, the metadata generating section 50 a generates a variety ofinformation (stereo image information) related to the stereo image. Anexample of stereo image information includes, for instance, trimminginformation. Trimming information is information representing effectiveimage frames of corresponding monocular images and indicates a regionfor use in recognizing a fused image during a stage of reproduction.

The stereo image generating section 50 b is configured to generate astereo image on the basis of a plurality of input monocular images. Forinstance, under a circumstance where one image is generated by focusinga plurality of monocular images present in an imaging area of the CCD34, the stereo image generating section 50 b generates a stereo imagewith the input images being used intact. In addition, under anothercircumstance where, for instance, a plurality of monocular images areseparately shot and input, the stereo image generating section 50 bgenerates a stereo image on the basis of the individual input monocularimages.

The image file generating section 50 c is configured to have capabilityof permitting the stereo image, resulting from the stereo imagegenerating section 50 b, to be converted into an electronic image filewith a predetermined format to be output. With the stereo imagebelonging to an integrated image, the image file generating section 50 cconverts one integrated image into an image format compliant with, forinstance, the JPEG standard or TIFF standard to form one image file.Further, with the stereo image composed of a plurality of monocularimages, the image file generating section 50 c forms one an image fileupon allocating the individual monocular images to corresponding pagesunder TIFF format.

During such operation, the image file generating section 50 c executesdigital compression of the stereo image according to needs forconversion to a digital image file with a predetermined format addedwith collateral data (metadata).

FIG. 2 is a block diagram showing a specific structure of the image filegenerating section 50 c shown in FIG. 1. FIG. 3 is an illustrative viewshowing one example of an image file produced by the image filegenerating section 50 c.

The image file generating section 50 c comprises a compressing section71 to which image data on the stereo image is input. The compressingsection 71 executes a predetermined compressing operation on image dataof the stereo image for output to a data synthesizing section 72.Metadata is also supplied to the data synthesizing section 72, whichconsequently synthesizes image data and metadata.

In the present embodiment, the image file generating section 50 cfurther includes a metadata date and time setting section 73 and animage file date and time setting section 74. The metadata date and timesetting section 73 is configured to have capability of outputtinginformation of created date and time on metadata related to variousstereo image information to the data synthesizing section 71. Further,the image file date and time setting section 74 is configured to have acapability of outputting information on created date and time of theimage file to the data synthesizing section 72. In addition, both themetadata date and time setting section 73 and the image file date andtime setting section 74 are configured to perform the setting of a dateand time for the last updating of the image file, that is, the settingof the same date and time in this case.

The data synthesizing section 72 synthesizes various input data intosynthesized data for delivery to a format section 75. The format section75 arranges various input data in accordance with a predetermined imageformat to output as one image file.

As shown in FIG. 3, the image file includes a header section and animage data section. The image data section is placed with image datacompressed with the compressing section 71. The header section has, inaddition to a file name of the image file and file creation (updating)date and time, metadata to be placed. Information on the file creation(updating) date and time is set by the image file date and time settingsection 74.

Metadata includes metadata discriminating information, information on adate and time at which an image is shot, and information related to astereo image. Note that, information on the shooting date and time isinformation included in metadata that is generated by the metadatagenerating section 50 a and input to the data synthesizing section 72.

Under a circumstance where image data placed in the image data sectionbelongs to a stereo image, stereo image information contains a varietyof information related to the stereo image. Trimming information isgenerated by the metadata generating section 50 a and contained inmetadata input to the data synthesizing section 72. A metadata creation(updating) date and time information is information set by the metadatadate and time setting section 73 and contains the metadata creation dateand time related to various stereo image information.

In addition, the file format shown in FIG. 3 is one example of an imagefile. While the file format, shown in FIG. 3, has been described withreference to an example of the metadata creation (updating) date andtime placed as one part of stereo image information, the metadatacreation (updating) date and time may be placed in another part of themetadata area.

Further, while the present embodiment has been described with referenceto an example where the controller 50 is 3D-compliant, if the controller50 is non-3D-compliant, for instance, a predetermined initial value isset in or no information is described in a description area of stereoimage information in the metadata area.

Next, the operation of the present embodiment with such a structure setforth above is described with reference to FIG. 4. FIG. 4 is a flowchart showing a sequence of operations to be executed by the image filegenerating section 50 c.

Now, supposing the stereo changeover switch 54 commands a stereoshooting mode. A subject optical image incident from the stereo adapter10 passes through the image pickup lens group 21, the exposure controlmechanism 22, the half mirror 31 and the filter system 32 and is thenfocused on the imaging area of the CCD color image pickup element 34.The CCD color image pickup element 34 outputs one image data containingleft and right monocular images L, R. The image signal output from theCCD color image pickup element 34 is input to the controller 50 via thepreprocessing circuit 36.

The stereo image generating section 50 b generates an integrated image,comprising monocular images on left and right areas, on the basis of theinput image signal. The metadata generating section 50 a generatesinformation on a shooting date and time, related to the generatedintegrated image, and stereo image information.

In step S1 shown in FIG. 4, the image file generating section 50 cexecutes a predetermined compressing operation on the generatedintegrated image (stereo image). In a subsequent step S2, the metadatadate and time setting section 73 of the image file generating section 50c generates information on a creation date and time of metadata relatedto stereo image information resulting from the metadata generatingsection 50 a. Note that, the metadata date and time setting section 73may be configured to treat a current time as a metadata creation dateand time. In step S3, the image file date and time setting section 74 ofthe image file generating section 50 c generates the same date and timeas that of the metadata creation date and time as information of theimage file creation date and time.

With the image file generating section 50 c, the data synthesizingsection 72 synthesizes information on a stereo image, metadata, ametadata creation date and time and an image file creation date and time(in step S4) and the format section 75 generates an image file with thedata format shown in FIG. 3 (in step S5).

The image file resulting from the image file generating section 50 c issupplied to the digital processing circuit 39. The digital processingcircuit 39 can display the integrated image on a display area of an LCD40 according to the input electronic image file. Moreover, the digitalprocessing circuit 39 can deliver the input electronic image file to thememory card 42 for storage via the card IF 41.

In addition, while the present embodiment has been described withreference to an example wherein information on the image file creationdate and time is matched to information on the metadata creation dateand time, it will be apparent that information on the metadata creationdate and time is matched to the image file creation date and time.

In the present embodiment, thus, the image file generated by the imagefile generating section is placed with, in addition to information onthe image file creation date and time, information on the metadatacreation date and time related to stereo image information. Informationof the metadata creation (updating) date and time related to stereoimage information is placed in the image file creation (updating) dateand time for independently executing management of the image filecreation (updating) date and time and the metadata creation (updating)date and time related to stereo image information. In a case where theimage file is generated (updated) with non-3D-compliant equipment orsoftware, no metadata creation (updating) date and time related tostereo image information is created or updated. Thus, comparinginformation on these dates and times enables judgment to be made todetermine whether or not the image file was generated (updated) withnon-3D-compliant equipment or software.

Moreover, while the present embodiment has been described with referenceto an example where the metadata creation (updating) date and time andthe image file creation (updating) date and time are matched to eachother, in general, an actual metadata creation (updating) date and timeand the image file creation (updating) date and time are nearly matchedto each other or a related time difference is relatively small. Thus,the actual creation (updating) data and time may be set. In such a case,since a difference between these dates and times is less than athreshold value, judgment can be made to determine whether or not theimage file was generated (updated) with non-3D-compliant equipment orsoftware.

Further, while the present embodiment has been described with referenceto an example where the image file is generated by the image processingapparatus equipped with the image file generating section, it is clearthat the image file generating section can be realized using softwareproviding the same function as that of the image file generatingsection. That is, by using a computer available to work on programshaving the same function as that of the flow chart shown in FIG. 4, itbecomes possible to prepare the same image file generating section asthat shown in FIG. 2.

Furthermore, in a case where the image file generating section 50 c isstructured with software, for instance, the image file date and timesetting section 74 is generally composed of an operation system, etc.,of a computer and the image file creation (updating) date and time isautomatically described when the file is generated (updated).

Although the present embodiment has been described with reference to anexample where data such as a file name and a file creation (updating)date and time are placed in the header section of the image file, suchdata may be placed in a directory entry area that is directly placed inand managed by an OS of a computer.

Moreover, although the first embodiment has been described withreference to an example applied to the electronic camera, the presentinvention can be applied to an independent image processing apparatusadapted to process an image picked up with an electronic camera and canalso be arranged to accomplish a similar function with the use ofprograms of a personal computer or the like for processing the picked upimage.

Besides, while the present embodiment has been described with referenceto an example where the camera obtains one image having left and rightareas placed with the monocular images and the stereo image is generatedon the basis of such images, it is clear that the present invention canbe applied to a case wherein, for instance, individual monocular images,obtained by independently shooting a subject with two cameras, areseparately input and one stereo image is generated on the basis of thesemonocular images.

Second Embodiment

FIG. 5 is a block diagram showing an image processing and editingapparatus of a second embodiment according to the present invention andFIG. 6 is a flow chart showing a process flow for generating an imagefile. The present embodiment is applied to an image file editingapparatus. Note that, the present embodiment can also be realized usingsoftware having the same function as that of the apparatus shown in FIG.5.

A decoder section 81 is input with the image file having the data formatshown in FIG. 3. The decoder section 81 decodes the input image file andretrieves various data from the image file. The decoder section 81delivers image data of the image file to an image expanding section 82while supplying metadata to a metadata processing section 84.

The image expanding section 82 expands input image data and obtainsimage data before compression thereof. This image data is supplied to animage processing and editing section 83.

The image processing and editing section 83 executes the processing andediting of the input image data depending on processing and editingoperations executed by a user (in step S11) and outputs an image,subjected to the processing and editing, to an image file generatingsection 86. Note that, the image processing and editing section 83 canrefer to metadata on an image to be processed and edited for use in theprocessing and editing.

The metadata processing section 84 updates metadata on the basis of theprocessing and editing operations executed by the image processing andediting section 83. For instance, in a case where the processing andediting operations of the image processing and editing section 83 belongto operation for expanding a stereo image, the metadata processingsection 84 updates trimming information representing an optimum clippingarea in response to such expanding operation.

An image file generating section 86 synthesizes image data, deliveredfrom the image processing and editing section 83, and metadata,delivered from the metadata processing section 84, and generates animage file with the file format shown in FIG. 3. A date and timeupdating section 87, incorporated in the image file generating section86, is supplied with current time information from a timer 88 and setsfile updating date and time information (in step S12). The image filegenerating section 86 rewrites a file creation (updating) date and time(see FIG. 3) in the file format to such updating date and timeinformation. Further, the image file generating section 86 rewrites ametadata creation (updating) date and time (see FIG. 3) in the fileformat to the same date and time information as the file creation(updating) date and time (in step S13). Thus, the image file generatingsection 86 generates and outputs an image file in which the filecreation (updating) date and time and the metadata creation (updating)date and time are altered to the same dates and times (in step S14).

With the present embodiment, thus, metadata is updated with theprocessing and editing of the image and alters the relevant updatingdate and time to a current date and time identical to the image filecreation (updating) date and time. This results in matching between theimage file creation (updating) date and time and the metadata creation(updating) date and time as far as the image is processed and editedwith the use of the editing apparatus of the present embodiment.

Note that, information on the metadata updating date and time and theimage file updating date and time may not necessarily depend on anactual updating date and time provided that the same date and timeexists.

Third Embodiment

FIG. 7 is a block diagram showing an image file reproducing apparatus ofa third embodiment according to the present invention. FIG. 8 is a flowchart showing a process flow of an image file. The present embodiment isapplied to an image file reproducing apparatus. Note that, the presentembodiment may be realized with software having the same function asthat of the apparatus shown in FIG. 7.

A decoder section 91 is input with the image file having the file formatshown in FIG. 3. The decoder section 91 decodes the input image file andretrieves various data from the image file. The decoder section 91supplies image data of the image file to an image expanding section 92while supplying metadata to a metadata nullifying section 95 and a dateand time judgment section 94.

The image expanding section 92 expands input image data and obtainsimage data prior to compression thereof. This image data is supplied toa reproduction processing section 93.

The date and time judgment section 94 obtains information on the filecreation (updating) date and time (see FIG. 3) and metadata creation(updating) date and time (in step S21). The date and time judgmentsection 94 makes judgment as to whether or not the file creation(updating) date and time matches the metadata creation (updating) dateand time (in step S22). The date and time judgment section 94 outputs ajudgment result to a changeover section 96 and an alarm section 97.

Note that, the date and time judgment section 94 may be arranged to makejudgment that information of both the dates and times match each otheras far as the metadata creation (updating) date and time and the filecreation (updating) date and time fall in a predetermined thresholdvalue. However, when taking into consideration the occurrence oferroneous judgment caused depending on the threshold value being set,judgment is principally made that both the dates and times match eachother only when these dates and times are completely identical.

The metadata nullifying section 95 nullifies input metadata (in stepS24). For instance, the metadata nullifying section 95 executes thenullification by deleting parameters of metadata, related to the stereoimage, or setting the same to initial values.

The changeover section 96 selectively supplies one of metadata,delivered from the decoder section 91, and metadata, delivered from themetadata nullifying section 95, to the reproduction processing section93 on the basis of a judgment result of the date and time judgmentsection 94. For instance, with a judgment result predetermined with thedates and times matched, the changeover section 96 supplies metadatafrom the decoder section 91 to the reproduction processing section 93and with a judgment result predetermined with the dates and timesunmatched, the changeover section 96 inhibits reproduction processing(in step S24).

The reproduction processing section 93 executes predeterminedreproduction processing on image data using metadata delivered from thechangeover section 96 (in step S25). Further, the reproductionprocessing section 93 may be configured to supply metadata information,set by the metadata nullifying section 95, to the reproductionprocessing section 93 upon receipt of a judgment result representingthat the dates and times delivered from the date and time judgmentsection 94 are unmatched.

With the judgment result of the date and time judgment section 94representing the dates and times unmatched, an alarm section 97 providesa user with, for instance, an alarm using, for instance, an alarmdisplay or the like.

With the present embodiment, thus, if both the dates and times of animage file, in which the creation (updating) dates and times, at which afile and metadata are generated, are independently described,reproduction processing is inhibited as having no correlation betweenimage data and metadata or reproduction processing is executed usingnullified metadata. By so doing, reproduction processing can beprevented from being executed using metadata having no correlation toimage data under a situation where the image is processed and editedwith non-3D-compliant equipment or software.

Fourth Embodiment

FIG. 9 is a block diagram showing an electronic camera incorporating animage processing apparatus of a fourth embodiment according to thepresent invention. The present embodiment is applied to an image filerecording apparatus. The same component parts as those of FIG. 1 bearthe same reference numerals in FIG. 9 for omission of redundantdescription.

A camera body 101 of the present embodiment differs from the camera body1 of the first embodiment in that a system controller 150 is employed inplace of the system controller 50. The system controller 150 differsfrom the system controller 50 in that a metadata generating section 150a and an image file generating section 150 c are adopted in place of themetadata generating section 50 a and the image file generating section50 c.

The metadata generating section 150 a, playing a role as a collateraldata generating means, generates various collateral data (hereinafterreferred to metadata) related to a picked up image for delivery to theimage file generating section 150 c. For instance, the metadatagenerating section 150 a generates information on a shooting date andtime and when the picked up image includes a stereo image, variousinformation (stereo image information) related to a stereo image isgenerated. Stereo image information may include, for instance, anoptimum trimming position that is trimming information. Information onthe optimum trimming position is information representing effectiveimage frames of individual monocular images and indicates an area foruse in recognizing a fused image during reproduction thereof. Inaddition, stereo image information may also include information on amaximal protruding amount that specifies the maximum value with a depthfeeling of the stereo image.

The image file generating section 150 c is configured to be capable ofconverting and outputting the stereo image, generated by the stereoimage generating section 50 b, to an electronic image file with apredetermined format. Under a circumstance where the stereo imagebelongs to an integrated image, the image file generating section 150 cconverts one integrated image to an image format with, for instance,JPEG standard or TIFF standard into one image file. Under a circumstancewhere the stereo image is composed of a plurality of monocular images,the image file generating section 150 c allocates the individualmonocular images to individual pages with TIFF formats into one imagefile.

In such a case, the image file generating section 150 c executesprocessing to compress the stereo image depending on needs forconversion into a digital image file with a predetermined format addedwith collateral data (metadata).

FIG. 10 is a block diagram showing a specific structure of the imagefile generating section 150 c shown in FIG. 9. In addition, FIG. 11 isan illustrative view showing an example of an image file generated bythe image file generating section 150 c.

A compressing section 171 of the image file generating section 150 c isinput with image data of the stereo image. The compressing section 171executes predetermined operation to compress image data of the stereoimage that is output to a data synthesizing section 172. Metadata isalso input to the data synthesizing section 172, by which image data andmetadata are synthesized.

With the present embodiment, the image file generating section 150 cfurther includes a metadata size setting section 173 and an image filesize setting section 174. The metadata size setting section 173 isconfigured to have capability of outputting information of the stereoimage with an image size (3D-image size) (in pixel count) to the datasynthesizing section 172. Further, the image file size setting section174 is configured to have capability of outputting information of animage with an image size (pixel count) depending on image data. Notethat, the metadata size setting section 173 and the image file sizesetting section 174 play roles to set information with an image size ofthe image depending on identical image data and, accordingly, if imagedata is data related to the stereo image, the outputs of the settingsections 173, 174 result in information with the image sizes equal toeach other.

The data synthesizing section 172 synthesizes various input data fordelivery to a format section 175. The format section 175 allows variousinput data to be arranged in accordance with a predetermined imageformat and outputs such input data as one image file.

As shown in FIG. 11, the image file has a header section and an imagedata section. Image data, compressed by the compressing section 171, isplaced in the image data section. The header section is placed with afile name of an image file, information on an image size, and metadata.Information on the image size is set by the image file size settingsection 174.

Metadata contains metadata discriminating information, an image shootingdate and time information, and stereo image information. Note that,shooting date and time information includes information that isgenerated by the metadata generating section 150 a and contained inmetadata being input to the data synthesizing section 172.

If image data, placed in the image data section, belongs to stereoimage, stereo image information contains a variety of informationrelated to the stereo image. The metadata generating section 150 agenerates information on the optimum trimming position and informationon the maximal protruding amount that are included in metadata beinginput to the data synthesizing section 172. Information on the 3D imagesize is information set by the metadata size setting section 173 andrepresents an image size of the stereo image on the basis of image data.Here, as described above, 3D image size information recorded as metadataand image size information recorded in the header section of the imagefile have the same contents.

Moreover, while the file format shown in FIG. 11 represents one exampleof the image file and FIG. 11 has been explained with reference to anexample wherein the 3D image size is placed as a part of stereo imageinformation, the 3D image size may be located in another area ofmetadata.

Further, while with the present embodiment, the controller 150 has beendescribed as being 3D-compliant, if the controller 150 isnon-3D-compliant, for instance, a predetermined initial value is set ina description area of stereo image information in the metadata area ornone of information is described therein.

Next, the operation of the present embodiment with such a structure isdescribed below with reference to FIG. 12. FIG. 12 is a flow chartshowing an operational flow of the image file generating section 150 c.

Now, suppose the stereo changeover switch 54 commands a stereo shootingmode. A subject optical image, incoming through the stereo adapter 10,passes through the shooting lens group 21, the exposure controlmechanism 22, the half mirror 31 and the filter system 32 and is focusedon the imaging area of the CCD color image pickup element 34. The CCDcolor image pickup element 34 outputs data of one image containing theleft and right monocular images L, R. The image signal delivered fromthe CCD color image pickup element 34 is input to the controller 150 viathe preprocessing circuit 36.

The stereo image generating section 50 b generates an integrated imagewith monocular images placed on left and right areas on the basis of theinput image signal. The metadata generating section 150 a generatesshooting date and time information, related to the resulting integratedimage, and stereo image information.

In step S101 of FIG. 12, the image file generating section 150 cexecutes predetermined operation to compress the resulting integratedimage (stereo image). In subsequent step S102, the metadata size settingsection 173 of the image file generating section 150 c generatesinformation of an image size (3D image size) of the stereo image to bestored in the image data section. In step S103, the image file sizesetting section 174 of the image file generating section 150 c generatesinformation on the image size of the image to be stored in the imagedata section. That is, in this case, the 3D image size, set by themetadata size setting section 173, and the image size, set by the imagefile size setting section 174, take the same values.

The image file generating section 150 c allows the data synthesizingsection 172 to synthesize information related to a stereo image,metadata, a 3D image size and image size (in step S104), after which theformat section 175 generates an image file with the data format shown inFIG. 11 (in step S105).

The image file, generated by the image file generating section 150 c, issupplied to the digital processing circuit 39. The digital processingcircuit 39 can provide a display of the integrated image on a displayscreen of the LCD 40 on the basis of the input electronic image file.Further, the digital processing circuit 39 can also supply the inputelectronic image file via the card file IF 41 to the memory card 42 forstorage therein.

With the present embodiment, thus, the image file generated by the imagefile generating section has metadata placed with, in addition toinformation related to the image size of the image on the basis of imagedata of the image file, the 3D image size of the same image. Informationon the image size of the stereo image is placed independently ofinformation on the image size of the header section of the image fileand such information can be managed in a separate fashion. With theimage file generated (updated) with non-3D-compliant equipment orsoftware, no 3D image size of metadata related to the stereo imageinformation is generated nor updated. Therefore, comparing informationon these image sizes with respect to each other enables judgment to bemade as to whether or not the image file is generated or updated withnon-3D-compliant equipment or software.

Further, while the present embodiment has been set forth above withreference to an example wherein the image processing apparatus,including the image file generating section, generates the image file,it is apparent that the image file generating section can be realizedusing software having a similar function. That is, by using a computercapable for executing programs having the same functions as those of theflow chart shown in FIG. 12, the image file generating section similarto that shown in FIG. 10 can be formed.

Furthermore, in a case where the image file generating section 150 c isstructured with software, the image file setting section 174 may bestructured with, for instance, an operation system or the like of acomputer and an image size of the image file may be automaticallydescribed during the generation (updating) of the file in commonpractice.

Moreover, while the fourth embodiment has been described with referenceto an example as applied to the electronic camera, the presentembodiment may have another application to a sole image processingapparatus arranged to process an image shot by the electronic cameraand, also, can achieve a similar function through the use of programs ofa personal computer or the like adapted to process a picked up image.

In addition, while the present embodiment has been described withreference to an example wherein one image with the monocular imagesplaced on left and right areas is obtained with the camera and thestereo image is generated on the basis of such an image, it is apparentthat the present embodiment can be applied to a structure wherein, forinstance, individual monocular images, obtained upon shooting with twocameras in separate ways, are independently input to allow one stereoimage to be generated on the basis of these monocular images.

Fifth Embodiment

FIG. 13 is a block diagram showing an image processing and editingapparatus of a fifth embodiment according to the present invention andFIG. 14 is a flow chart showing a process flow for generating an imagefile. The present embodiment is applied to the image file editingapparatus shown in FIG. 11. Note that, the present embodiment can berealized using software having the same functions as those of theapparatus shown in FIG. 13.

A decoder section 181 is input with the image file having the dataformat shown in FIG. 11. The decoder section 181 decodes the input imagefile and retrieves various data from the image file. The decoder section181 delivers image data of the image file to an image expanding section182 while delivering metadata to a metadata processing section 184.

The image expanding section 182 expands input image data and obtainsimage data prior to compression thereof. This image data is supplied toan image processing and editing section 183.

The image processing and editing section 183 executes the processing andediting of the input image data depending on processing and editingoperations executed by a user (in step S111) and outputs an image data,subjected to the processing and editing, to an image file generatingsection 186. Note that, the image processing and editing section 183 canrefer to metadata of image data, which is processed and edited, for usein the processing and editing operations.

The metadata processing section 184 updates metadata on the basis of theprocessing and editing operations of the image processing and editingsection 183. For instance, in a case where the processing and editingoperations of the image processing and editing section 183 belong totrimming operation for a stereo image, the metadata processing section184 updates information on an optimum trimming position, indicative ofan optimum clipping area in compliance with such trimming operation, andinformation on a maximal protruding amount.

An image file generating section 186 synthesizes image data, deliveredfrom the image processing and editing section 183, and metadata,delivered from the metadata processing section 184, for generating animage file with the file format shown in FIG. 11. A size updatingsection 187 of the image file generating section 186 has the samefunctions as those of the metadata size setting section 173 and theimage size setting section 174, shown in FIG. 10, and generates imagesize information on an image resulting from the image processing andediting section 183 upon processing and editing operations thereof (instep S112). The image file generating section 186 rewrites image sizeinformation (see FIG. 11) of the image file in the file format toinformation generated by the size updating section 187. Further, theimage file generating section 186 rewrites 3D image size information(see FIG. 11) of metadata in the file format to information generated bythe size updating section 187 (in step S113). Thus, the image filegenerating section 186 generates and outputs an image file in which theimage size in the image file and the 3D image size in metadata arealtered to the same information (in step S114).

With the present embodiment, thus, metadata is updated in accordancewith the processing and editing of the image and image size information,altered in accordance with the processing and editing, is written in theimage size in the image file and the 3D image size in metadata. Thisallows the image size in the image file and the 3D image size inmetadata to match each other in information as far as the image isprocessed and edited using the editing apparatus of the presentembodiment.

Sixth Embodiment

FIG. 15 is a block diagram showing an image file reproducing apparatusof a sixth embodiment according to the present invention and FIG. 16 isa flow chart showing a process flow of an image file. The presentembodiment is applied to the image file reproducing apparatus shown inFIG. 11. Note that, the present embodiment may be realized usingsoftware having the same functions as those of the apparatus shown inFIG. 15.

A decoder section 191 is input with the image file having the fileformat shown in FIG. 11. The decoder section 191 decodes the input imagefile and retrieves various data from the image file. The decoder section191 delivers image data of the image file to an image expanding section192 while delivering metadata to a changeover section 196, a metadatanullifying section 195 and a size judgment section 194.

The image expanding section 192 expands input image data and obtainsimage data prior to compression thereof. This image data is supplied toa reproduction processing section 193.

The size judgment section 194 obtains information on the image size inthe image file (see FIG. 11) and information on a 3D image size inmetadata (in step S121). The size judgment section 194 makes judgment asto whether or not the image size in the resulting image file and the 3Dimage size in metadata match each other (in step S122). The sizejudgment section 194 outputs a judgment result to the changeover section196 and an alarm section 197.

The metadata nullifying section 195 nullifies input metadata (in stepS124). For instance, the metadata nullifying section 195 allowsparameters of metadata, related to the stereo image, to be deleted orset to initial values for thereby executing the nullification.

On the basis of the judgment result of the size judgment section 194,the changeover section 196 selectively supplies one of metadata,delivered from the decoder section 191, or metadata, delivered from themetadata nullifying section 195, to the reproduction processing section193. For instance, the changeover section 196 supplies metadata from thedecoder section 191 to the reproduction processing section 193 inresponse to a judgment result representing matched image sizes andinhibits the reproduction processing in response to a judgment resultindicative of the unmatched image sizes (in step S24).

The reproduction processing section 193 executes predeterminedreproduction processing on image data using metadata delivered from thechangeover section 196 (in step S125). Further, the reproductionprocessing section 193 may be configured to supply metadata information,set by the metadata nullifying section 195, to the reproductionprocessing section 193 when supplied with a judgment result representingthe unmatched image sizes from the size judgment section 194.

An alarm section 197 is configured to provide a user with, for instance,an alarm using, for instance, an alarm display or the like when thejudgment result from the size judgment section 194 represents theunmatched image sizes.

With the present embodiment, thus, for the image file with individualimage sizes independently described in the file header and metadata,reproduction processing is inhibited as having no correlation betweenimage data and metadata, when both the image sizes are unmatched, orexecuted using nullified metadata. By so doing, under a circumstancewhere the image is processed and edited with non-3D-compliant equipmentor software, reproduction processing using metadata with no correlationto image data can be prevented.

Note that, while the each embodiment has been described with referenceto the stereo system of the two-eye system associated with the left andright both eyes, it is needless to say that the present invention can beapplied to a common multiple-eye stereo system with more than threeeyes.

Further, it is apparent that the present invention can also be appliedto a moving image.

Having described the preferred embodiments of the invention referring tothe accompanying drawings, it should be understood that the presentinvention is not limited to those precise embodiments and variouschanges and modifications thereof could be made by one skilled in theart without departing from the spirit or scope of the invention asdefined in the appended claims.

What is claimed is:
 1. An image file processing apparatus comprising: asystem controller comprising a CPU; a stereo image data generating unitfor generating stereo image data based on a plurality of monocularimages of a same subject obtained with a predetermined parallax; acollateral data generating unit for generating collateral data relatedto the stereo image data; a first date and time generating unit forgenerating a first date and time at which the collateral data isgenerated; and an image file generating unit for generating an imagefile that includes the stereo image data, the collateral data, the firstdate and time, and a second date and time at which the image file isgenerated; wherein the stereo image data generating unit, the collateraldata generating unit, and the image file generating unit are implementedby the system controller, wherein the first date and time is updatedwhen the stereo image is edited by 3D-compliant image editing equipmentbut not updated when the stereo image is edited by non-3D-compliantimage editing equipment; and wherein the second date and time is updatedwhen the stereo image is edited by either of the 3D-compliant imageediting equipment and the non-3D-compliant image editing equipment. 2.The image file processing apparatus according to claim 1, furthercomprising: a judging unit for judging a coincidence between the firstdate and time and the second date and time in the image file by acomparison with a predetermined threshold value; and a reproducing unitfor (i) performing reproduction of the stereo image data in the imagefile using the collateral data in the image file if the judging unitjudges that a difference between the first date and time and the seconddate and time is smaller than the predetermined threshold value, and(ii) inhibiting reproduction of the stereo image data if the judgingunit judges that the difference between the first date and time and thesecond date and time is greater than the predetermined threshold value.3. The image file processing apparatus according to claim 1, furthercomprising: an image editing unit for editing the stereo image data inthe image file using the collateral data in the image file; a collateraldata updating unit for updating the collateral data in the image filebased on a content of the editing; and a date and time updating unit forupdating the first date and time in the image file at which thecollateral date is updated and the second date and time at which theimage file is updated.
 4. An image file processing method, the methodcomprising: a stereo image data generating step of generating stereoimage data based on a plurality of monocular images of a same subjectobtained with a predetermined parallax; a collateral data generatingstep of generating collateral data related to the stereo image data; afirst information generating step of generating a first date and time atwhich the collateral date is generated; and an image file generatingstep of generating an image file that includes the stereo image data,the collateral data, the first date and time, and a second date and timeat which the image file is generated; wherein the stereo image datagenerating step, the collateral data generating step, the firstinformation generating step, and the image file generating step areperformed under control of a system controller comprising a CPU, whereinthe first date and time is updated when the stereo image is edited by3D-compliant image editing equipment but not updated when the stereoimage is edited by non-3D-compliant image editing equipment; and whereinthe second date and time is updated when the stereo image is edited byeither of the 3D-compliant image editing equipment and thenon-3D-compliant image editing equipment.
 5. The image file processingmethod according to claim 4, the method further comprising: a judgingstep of judging a coincidence between the first date and time and thesecond date and time in the image file by a comparison with apredetermined threshold value; and a reproducing step of, in response tothe judging, (i) performing reproduction of the stereo image data in theimage file using the collateral data in the image file if it is judgedthat a difference between the first date and time and the second dateand time is smaller than the predetermined threshold value, and (ii)inhibiting reproduction of the stereo image data if it is judged thatthe difference between the first date and time and the second date andtime is greater than the predetermined threshold value.
 6. The imagefile processing method according to claim 4, the method furthercomprising: an image editing step of editing the stereo image data inthe image file using the collateral data in the image file; a collateraldata updating step of updating the collateral data in the image filebased on a content of the editing; and a first information updating stepof updating the first date and time in the image file at which thecollateral date is updated and the second date and time at which theimage file is updated.